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(57) Abstract: A remote view station (26) is communicatively coupled to an image server (24) and receives a compressed version 
of source medical images. The remote view station (26) uncompresses and displays the received medical image. A medical profes- 
sional, such as a pathologist, can select a region of the displayed medical image. Region information is transmitted back to the image 
server that applies image analysis operations on a region of the source medical image that corresponds to the selected region of the 
compressed medical image. In this manner, the data loss that occurs during image compression does not effect the image analysis 
operations. As such, the image analysis operations produce more accurate results than if the operations were applied by remote view 
station to the uncompressed image. 
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REMOTE INTERPRETATION OF MEDICAL IMAGES 

BACKGROUND 

Pathologists typically use microscopes when diagnosing physiological 
conditions such as cancer, infectious disease and prenatal disorders. Typically, tissue 
5 samples on a slide are loaded onto the microscope, the microscope objective or lens 
focuses on an area of the sample, and the sample is scanned for particular features or 
objects of interest. In this manner, the microscope helps the pathologist to visually 
determine the presence of abnormal numbers or types of cells, organelles, organisms 
or biological markers. 

10 Recently, automated microscopes have been integrated into medical imaging 

systems that include a variety of networked components. The medical imaging 
system provides an environment for storing and retrieving the medical images 
produced by the microscopes. The components of the medical imaging system are 
spread throughout the department or hospital, or even located remotely, and connected 

15 by a communication network. 

An image acquisition device is coupled to the microscope and captures images 
produced by the microscope. The image acquisition device can include a variety of 
components. For example, the image acquisition device can include a video camera 
coupled to a high-speed frame grabber for capturing the stream of video produced by 

20 the video camera and generating a series of digital images. Alternatively, the 

electronic camera can be a megapixel digital camera. The microscope and the image 
acquisition device can acquire images for a number of different color planes and at 
several different focal planes. These images can be stitched together to form a two- 
dimensional or three-dimensional composite image. As a result of the combination, 

25 and because the images are typically in color and at high-resolution, the composite 
images place significant storage and bandwidth requirements on the medical imaging 
system. For example, a composite image for a single tissue slide can often exceed a 
gigabyte in size. 

Image storage and archival devices provide a central library for storing the 
30 medical images captured by the image acquisition device. Image storage devices 
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include one or more databases and image servers for fast access to recently acquired 
images. Archival devices, such as optical disc jukeboxes and tape backup systems, 
provide long-term storage. When a pathologist wishes to view an archived image, the 
image is automatically "migrated" from the corresponding archival device to one of 
5 the image storage devices. 

Diagnostic quality view stations display the images captured by the image 
acquisition system. In order to assist the pathologist in interpreting a medical image, 
a view station is able to perform a variety of image processing operations on the 
medical image. For example, the pathologist at the view stations may invoke 

10 algorithms to perform densitometry on selected regions of the medical image in order 
to identify concentration of a particular analyte within the tissue sample. Other image 
processing operations are useful for finding objects within 1he image such as the 
nuclei of the cells, computing an integrated optical density for the nuclei of the cells 
and reporting the number of molecules per cell. Most image processing operations 

15 output a fixed number (score), often falling within a predetermined range. 

SUMMARY OF THE INVENTION 

In general, the invention facilitates the remote interpretation of medical 
images. In order to facilitate the timely diagnosis of a tissue sample, it is desirable 

20 that a medical professional, such as a pathologist, be able to remotely view and 
interpret a medical image. The immense size of a medical image for a single tissue 
sample typically makes remote viewing unworkable due to bandwidth constraints. 
Compression algorithms can produce an image suitable for transmission, but the data 
lost during compression can lead to inaccurate results from the image analysis 

25 operations. 

According to one aspect, the invention is directed to a system in which a 
remote view station is communicatively coupled to an image server and receives a 
compressed version of a source medical image. The remote view station 
uncompresses and displays the received medical image. The remote view station 
30 selects a region of the displayed medical image as a function of input received from a 
medical professional, such as a pathologist. Based on the input, the remote view 
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station transmits region information, such as a series of pixel coordinates, back to the 
image server. The image server applies image analysis operations to a region of the 
source medical image that corresponds to the selected region of the compressed 
medical image. In this manner, the data loss that occurs during image compression 
5 does not effect the image analysis operations. As such, the image analysis operations 
produce more accurate results than if the operations were applied by the remote view 
station on the compressed image. 

In another aspect, the invention is directed to a method for remotely 
interpreting medical images. According to the method, a compressed medical image 

10 is generated from a source medical image and transmitted from an image server to a 
remote view station for display. In one implementation, the compressed medical 
image is transmitted over a global packet-switched network such as the Internet. A 
region of the medical image displayed by the remote view station is selected in 
response to input from a medical professional. Region information, defining the 

15 selected region of the displayed medial image, is transmitted from the remote view 
station back to the image server. Based on the region information, image analysis 
operations are applied to a corresponding region of the source medical image. A 
resulting score is communicated to the remote view station for display. A diagnosis is 
received from the remote view station and associated with the source medical image 

20 in a database maintained by the image server. 

Various embodiments of the invention are set forth in the accompanying 
drawings and the description below. Other features and advantages of the invention 
will become apparent from the description, the drawings, and the claims. 



25 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram providing a high-level illustration of the various 
components of the invention, 

FIG. 2 is a flowchart illustrating one embodiment of a process for remotely 
interpreting medical images. 
30 FIG. 3 is a block diagram illustrates one embodiment of a computer suitable 

for implementing the various embodiments of the invention. 
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DETAILED DESCRIPTION 

Figure 1 is a block diagram illustrating a system 10 that facilitates remotely 
viewing and interpreting medical images. System 10 includes remote view station 26 
this is communicatively coupled to medical imaging system (MIS) 12 by network 20, 

5 which represents any packet-switched network such as a local area network or the 
Internet MIS 12 includes image acquisition devices 14 that represent any medical 
imaging device that generates digital medical images, such as an electronic camera 
used in conjunction with an automated microscope. Other image acquisition devices 
include computed tomography (CT), nuclear medicine, magnetic resonance imaging 

10 (MRI), ultrasound and X-ray devices. Image server 24 stores the images that are 
generated by image acquisition device 14 and, upon request, communicates the 
images to view stations 16 for display. Using view stations 16, a medical 
professional, such as a pathologist, can perform a variety of image processing 
techniques on selected regions to assist in rendering a diagnosis. 

15 As described in detail below, image server 24 of MIS 12 communicates 

compressed medical images to remote view station 26 for interpretation by a medical 
professional. Using a network software application, such as a web browser, the 
medical professional interacts with remote view station 26 to select various regions of 
interest within the image. Based on the selection, image server 24 applies image 

20 analysis functions directly to the source medical image stored on image server 24, 
thereby generating a more accurate score than if applied by remote view station 26 to 
the medical image after compression. The resultant score produced by the image 
processing operations is communicated to remote view station 26 to assist the medical 
professional in interpreting the medical image and rendering a diagnosis. 

25 Figure 2 is a flow chart illustrating one implementation of a process 28 that 

facilitates the interpretation of medical images via remote view station 26. Using a 
network software application the medical professional interacts with remote view 
station 26, accesses MIS 12 and receives a list of cases that are marked for review, 
i.e., cases in which images have been acquired by image acquisition devices 14 but 

30 have not been reviewed by a medical professional (30). Upon reviewing the list 

displayed by remote view station 26, the medical professional selects one of the cases 
for review (32). 

4 
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Based on the selection, image server 24 compresses medical images associated 
with the case and communicates the compressed images to remote view station 26 via 
network 20 (34). Remote view station 26 decompresses the images and displays the 
uncompressed images for review by the medical professional (36). The displayed 
5 image is not a pixel-by-pixel duplicate of the original source image stored on image 
server 24 because of data lossed during compression. Several algorithms, however, 
are known that can achieve a compression ratio, such that the compressed image uses 
relatively low bandwidth, without significantly changing the visual representation of 
the image. Therefore, compressing the image can be effectively lossless with respect 

10 to human vision. For example, it has been found that both JPEG compression and 
fractal image compression, when set for to moderate compression, result in images 
suitable for transmission without resulting in data loss perceptible with human vision. 

Using a pointing device, such as a light pen, mouse or track ball, the medical 
professional selects one or more regions of interest. The medical professional can tag 

1 5 a region for image processing or can request that image server 24 transmit image data 
for the selected region using a lower compression setting. For example, the medical 
professional can direct image server 24 to transmit an image using low compression 
or even to transmit an uncompressed pixel-by-pixel duplicate of the selected region. 
Remote view station 26 encodes the shape and size of the selected region and 

20 transmits the region information to MIS 12 by network 20 (38). The region 
information defines the boundaries of the selected regions and, in one 
implementation, is a set of pixel coordinates defining the outlines of the selected 
regions. As. such, the region information typically comprises a small amount 
information and can be quickly transmitted to image server 24. 

25 If the medical professional requests that image server 24 transmit image data 

for a region of interest using a lower compression setting, or no compression, then 
image server 24 extracts the corresponding pixel data from the source image and 
communicates the pixel data to remote view station 26 (40). In this fashion, the 
medical professional can view regions of interest at higher resolution, or even a pixel- 

30 per-pixel duplicate, without requiring that image server 24 transmit the entire source 
image across network 20. Upon viewing the region of interest, the medical 



5 



WO 01/75776 PCT/US01/10899 



professional can tag the region for image processing or can select sub-regions of 
interest 

If the medical professional tags a selected region for image processing, image 
server 24 executes the requested image processing operation on the corresponding 

5 source medical image (42). More specifically, image server 24 analyzes the region 
information received from remote view station 26 and applies the image processing 
operation to a subset of the pixel data of the source image. The subset pixel data is 
selected based on the boundaries defined by the region information received from 
remote view station 26. In this manner, the image processing operation produces a 

10 more accurate score than if the operation were applied by remote view station 26 to 
the image that has been compressed for transmission and then uncompressed for 
display at the remote view station. As such, the data loss that occurs during 
compression does not effect the image analysis. 

Image server 24 communicates the scores for each region to remote view 

15 station 26 for display to the medical professional (44). Based on the visual display of 
the medical image as well as the scores associated with regions of interest, the 
medical professional interprets the medical image and renders a diagnosis. For 
example, the medical professional may determine that a particular tissue sample is 
cancerous. Remote view station 26 communicates the diagnosis to MIS 12 for 

20 association with the appropriate case within a database maintained by image server 24 
(46). 

The invention can be implemented in digital electronic circuitry, or in 
computer hardware, firmware, software, or in combinations thereof. Furthermore, the 
invention can be implemented in one or more computer programs that are executable 

25 within an operating environment of a programmable system embodied and tangibly 
stored in a machine-readable storage device. 

Figure 3 illustrates an example of a computer 100 suitable for use as view 
station 26 in order to implement or perform various embodiments of the invention. 
As shown in Figure 3, the computer 100 includes a processor 112 that in one 

30 embodiment belongs to the PENTIUM® family of microprocessors manufactured by 
the Intel Corporation of Santa Clara, California. However, computer 100 can be 
implemented on computers based upon other microprocessors, such as the MIPS® 
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family of microprocessors from the Silicon Graphics Corporation, the POWERPC® 
family of microprocessors from both the Motorola Corporation and the IBM 
Corporation, the PRECISION ARCHITECTURE® family of microprocessors from 
the Hewlett-Packard Company, the SPARC® family of microprocessors from the Sun 
5 Microsystems Corporation, or the ALPHA® family of microprocessors from the 
Compaq Computer Corporation. 

Computer 100 includes system memory 113, including read only memory 
(ROM) 1 14 and random access memory (RAM) 115, which is connected to the 
processor 1 12 by a system data/address bus 116. ROM 114 represents any device that 

1 0 is primarily read-only including electrically erasable programmable read-only 

memory (EEPROM), flash memory, etc. RAM 115 represents any random access 
memory such as Synchronous Dynamic Random Access Memory. 

Within the computer 100, input/output bus 1 18 is connected to the 
data/address bus 1 1 6 via bus controller 1 19. In one embodiment, input/output bus 118 

1 5 is implemented as a standard Peripheral Component Interconnect (PCI) bus. The bus 
controller 119 examines all signals from the processor 1 12 to route the signals to the 
appropriate bus. Signals between the processor 112 and the system memory 1 13 are 
merely passed through the bus controller 119. However, signals from the processor 
112 intended for devices other than system memory 1 13 are routed onto the 

20 input/output bus 118. 

Various devices are connected to the input/output bus 1 1 8 including hard disk 
drive 120, floppy drive 121 that is used to read floppy disk 151, and optical drive 122, 
such as a CD-ROM drive that is used to read an optical disk 152. The video display 
124 or other kind of display device is connected to the input/output bus 1 18 via a 

25 video adapter 125 and preferably is a high-resolution display suitable for viewing 
medical images. Computer 100 also includes a modem 129 and network interface 53 
for communicating over network 20 via either a wired or wireless connection. 

A medical professional enter commands and information into the computer 
100 by using a keyboard 140 and/or pointing device, such as a mouse 142, which are 

30 connected to bus 1 1 8 via input/output ports 128. Other types of pointing devices (not 
shown in Figure 1) include track pads, track balls, joysticks, data gloves, head 
trackers, and other devices suitable for positioning a cursor on the video display 124. 

7 
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Software applications 136 and data are typically stored via one of the memory 
storage devices, which may include the hard disk 120, floppy disk 151, CD-ROM 152 
and are copied to RAM 1 15 for execution. Operating system 135 executes software 
applications 136 and carries out instructions issued by the user. The Basic 
Input/Output System (BIOS) 1 17 for the computer 100 is stored in ROM 1 14 and is 
loaded into RAM 115 upon booting. BIOS 1 17 is a set of basic executable routines 
that help transfer information between the computing resources within the computer 
100. 

This application is intended to cover any adaptation or variation of the present 
invention. It is intended that this invention be limited only by the claims and 
equivalents thereof. 



8 



WO 01/75776 PCT/US01/10899 

What is claimed is: 

1 . A method comprising: 

generating a compressed medical image from a source medical image; 
transmitting the compressed medical image to a remote view station 
5 for display; 

selecting a region of the displayed medical image; and 
applying image analysis operations to a region of the source medical 
image corresponding to the selected region of the compressed medical image. 

10 2. The method of claim 1 wherein transmitting the compressed medical image 
includes transmitting the compressed medical image over a global packet- 
switched network. 

3. The method of claim 1 and further including transmitting region information 
1 5 from the remote view station to an image server, wherein the region 

information defines the selected region of the displayed medial image. 

4. The method of claim 3, wherein the region information is a series of pixel 
coordinates. 

20 

5. The method of claim 1, wherein applying the image analysis operations 
includes outputting a score and communicating the score to the remote view 
station for display. 

25 6. The method of claim 1 and further including receiving a diagnosis from the 
remote view station and associating the diagnosis with the source medical 
image in a database. 

7. The method of claim 1 , wherein selecting the region of the compressed 
30 medical image includes receiving input from a pointing device controlled by a 

user to outline the region of the compressed medical image. 
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8. The method of claim 1, wherein generating a compressed medical image 
includes applying a compression algorithm that reduces data losses that are 
detectable with human vision. 



5 9. The method of claim 8, wherein generating a compressed medical image 
includes applying a JPEG compression algorithm. 

10. A system comprising 

an image server storing a source medical image; 
10 a remote view station communicatively coupled to the image server to 

receive a compressed version of the source medical image, wherein the remote 
view station includes an input device for selecting a region of the compressed 
medical image, and further wherein the image server applies an image analysis 
operation on a region of the source medical image that corresponds to the 
1 5 selected region of the compressed medical image. 



1 1 . The system of claim 1 0, wherein the remote view station transmits region 
information from the remote view station to the image server, wherein the 

20 region information includes a plurality of pixel coordinates outlining the 

selected region of the compressed image. 

12. The system of claim 10, wherein the image server applies the image analysis 
operations to generate a score and communicates the score to the remote view 

25 station for display. 

13. The system of claim 10, wherein the image server includes a database 
associating a diagnosis received from the remote view station with the source 
medical image. 

30 
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14. The system of claim 10, wherein the remote view station includes a pointing 
device controllable by a user to outline the region of the compressed medical 
image. 

5 15. A computer program, tangibly stored on a computer-readable medium, 
comprising instructions operable to cause a programmable processor to: 

generate a compressed medical image from a source medical image; 
transmit the compressed medical image to a remote view station for 
display; 

1 0 receive region information from the remote view station, wherein the 

region information defines a region within the compressed medical image; and 

apply image analysis operations to a region of the source medical 
image as a function of the region information. 

15 16. The computer program of claim 1 5 and further including instructions to cause 
the processor to transmit the compressed medical image over a global packet- 
switched network. 

17. The computer program of claim 15 wherein the region information is a series 
20 of pixel coordinates. 

1 8. The computer program of claim 1 5 and further including instructions to cause 
the processor to output a score and communicating the score to the remote 
view station for display 

25 

19. The computer program of claim 15 and further including instructions to 
receive a diagnosis from the remote view station and associate the diagnosis 
with the source medical image in a database. 

30 20. The computer program of claim 1 5 and further including instructions to apply 
a compression algorithm that reduces data losses that are detectable with 
human vision. 

11 
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21. A computer-readable medium having a data structure stored thereon 
comprising: 

a data field identifying a source medical image; 
5 a data field identifying a compressed version of the source medical 

image; and 

a data field storing an output score from an image analysis operation 
applied to a region of the source medical image. 

10 22. The computer-readable medium of claim 2 1 , wherein the data structure 
includes a data field associating a diagnosis with the source the medical 
image. 

23 . A method comprising: 

15 compressing a source medical image at a compression level; 

transmitting the compressed medical image to a remote view station 
for display; 

receiving region information from the remote view station, wherein the 
region information defines a region of the compressed medical image; and 
20 compressing a region of the source medical image at a second 

compression level as a function of the region information. 

24. The method of claim 22 wherein transmitting the compressed medical image 
includes transmitting the compressed medical image over a global packet- 

25 switched network. 

25. The method of claim 23, wherein the region information is a series of pixel 
coordinates. 

30 26. The method of claim 23 and further including receiving a diagnosis from the 
remote view station and associating the diagnosis with the source medical 
image in a database. 

12 



WO 01/75776 



PCT/US01/10899 



27. A method comprising: 

transmitting a medical image to a remote view station for display; 

receiving region information from the remote view station, wherein the 
region information defines a region of the displayed medical image; and 

locally applying an image processing operation at the image server to a 
region of the source medical image as a function of the region information. 

28. The method of claim 27 wherein transmitting the medical image includes 
transmitting the medical image over a global packet-switched network. 

29 . The method of claim 27, wherein the region information is a series of pixel 
coordinates. 

30. The method of claim 27, wherein transmitting the medical image includes 
compressing medical image. 
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FIG. 1 
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